Python Job: Data Engineer

Job description: Apply strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analyzed, and architecting solutions for data scientists that enable them to do their jobs.

Responsibilities

· Develop, construct, test and maintain architectures, such as databases and large-scale processing systems

· Ensure architecture will support the requirements of the data scientists, the stakeholders, and the business.

· Discover opportunities to acquire new data from other systems

· Develop and improve data set processes for data modeling, mining, and production.

· Employ a variety of languages and tools to marry systems together

· Recommend and implement ways to improve data reliability, efficiency, and quality.

· Collaborate with stakeholders including the Product owner, data science, and design teams to assist with data-related technical issues and support their data infrastructure needs.

· Create data tools for analytics and data scientist team members that assist them in building and optimizing the products that help business achieving their goals.

· Work with data and analytics experts to strive for greater functionality in data systems.

Technical expertise

· BSc/MSc in Computer Science, Computer Science, Information Systems, or related Technical Discipline

· 1-4 years’ experience in Data Engineer role (5-10 years for senior data engineer)

· Deep knowledge of Python, SQL, and PySpark is required.

· Experience working with data pipelines, architecture principles, batch, and stream processing systems, and DataOps.

· Experience working with large data sets, Azure cloud services including Azure Data Lake, Data factory, Databricks, Azure DevOps.

· Background in programming in Python, Scala, C, C++, Java is beneficial.

· Experience working in AI startup environment or organizations with an agile culture

Agile experience

· Experience working in AI startup environment or organisations with an agile culture

· Professional attitude and service orientation; superb team player

Individual skills

· Good written and verbal communication skills along with strong desire to work in cross-functional teams

Mindset & behaviours

· Able to build a sense of trust and rapport that creates a comfortable & effective workplace; collaborative

· Attitude to thrive in a fun, fast-paced, startup-like environment

· Open minded to new approaches and learning

Job Type: Full-time

Schedule:

• 8 hour shift
• Monday to Friday

Application question(s):

• What is you salary expectation?
• What is your residential status in Canada (PR, Open Work Permit, etc.)?

Experience:

• Data Engineer: 3 years (preferred)
• PySpark: 3 years (preferred)
• Azure: 3 years (preferred)

Work Location: Remote